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A.  STATEMENT  OF  THE  PROBLEM  STUDIED 

In  this  section  we  summarize  our  work  over  the  three  year  period  of  the  research  grant. 
Our  work  has  centered  on  reasoning  with  incomplete  or  uncertain  data,  especially  with  atten¬ 
tion  to  areas  in  which  parallelism  could  be  exploited.  The  research  contributions  from  this 
work  range  from  theoretical  investigations  to  experimental  and  practical  results.  Numbered 
references  in  brackets  (e  g.,  [5] )  are  to  the  18  papers  we  published  during  the  grant  period, 
listed  in  section  C  below;  other  references  are  found  after  that,  and  indicated  by  letters  in 
brackets  (e  g..  [B. ). 

Non-monotonic  reasoning  (NMR)  is  a  form  of  reasoning  with  highly  unusual  formal  pro¬ 
perties.  A  key  idea  in  NMR  is  that  of  drawing  conclusions  about  the  typicality  of  an  entity  x 
with  respect  to  a  property  P,  so  that,  wLci.  uo  contrary  evidence  is  present,  Px  is  concluded. 
That  is,  in  such  circumstances  x  is  deemed  to  be  typical  (to  have  property  P).  For  instance,  if 
Soviet  missiles  are  typically  in  good  working  order,  and  m37  is  a  given  Soviet  missile,  then  in 
the  absence  of  evidence  to  the  contrary  it  will  be  supposed  that  m37  is  in  good  working  order. 
Since  rarely  are  all  the  relevant  facts  in  a  complex  setting  known,  such  reliance  on  typicalities 
in  terms  of  available  evidence  becomes  a  matter  of  considerable  importance. 

Some  of  our  efforts  have  gone  into  studying  theoretical  aspects  of  NMR,  in  the  specific 
area  of  circumscription.  Specifically,  the  phrase  “when  no  contrary  evidence  is  present"  given 
above  is  very  difficult  to  incorporate  into  a  deductive  formalism  We  have  considered  this 
from  several  directions,  including  circumscription  and  step  logic.  However,  NMR  also  (and 
principally)  has  applications  to  the  study  of  intelligent  (commonsense)  reasoning,  such  as  the 
study  of  belief  systems  of  intelligent  agents.  For  instance,  communicating  agents  tend  to 
make  significant  use  of  tacit  cooperation  principles,  such  as  giving  not  merely  correct  answers 
to  questions,  but  also  informative  and  not  misleading  answers.  This  in  turn  depends  strongly 
on  the  set  of  beliefs  (and  intentions)  of  the  agents  involved.  NMR  can  be  used  to  model  such 
principles  via  making  suppositions  about  what  another  agent  does  or  does  not  know  or 
believe,  again  based  on  ideas  of  typicality.  Thus  ths  study  of  belief  systems  forms  an  impor¬ 
tant  area  of  research  involving  NMR. 

Moreover,  questions  of  efficiency  plague  NMR,  since  many  of  the  formal  methods  used 
involve  either  semi-decidable  or  undecidable  problems,  and  also  since  realistic  databases  for 
commonsense  are  so  large  that  even  ordinary  (monotonic)  reasoning  is  slow.  For  these  reasons, 
among  others,  many  researchers  in  AI  look  to  both  resource-limited  and  parallel  inference  as  a 
way  to  significantly  speed  up  deductions.  We  have  been  exploring  both  parallel  and  resource- 
limited  methods  for  calculating  non-monotonic  conclusions. 

Thus  our  research  can  be  categorized  in  terms  of  the  following  inter-related  concepts: 

•  Non-monotonic  reasoning  and  circumscription 

•  Relief  systems  and  deductive  databases  (in  which  we  take  account  of  models  of  an  intelli¬ 
gent  agent's  belief  set,  especially  with  regard  to  intelligent  answers  to  queries  in  deductive 
databases) 

•  Resource-limited  non-monotonic  belief  systems  (a  special  case  of  the  above,  in  which  the 
non-monotonic  nature  of  beliefs  is  studied) 

•  Parallelism  in  non-monotonic  belief  systems  (in  which  parallel  methods  of  computation  are 
exploited  with  regard  to  the  above) 

During  the  three  year  grant  period,  we  have  published  11  conference  papers  and  7  jour¬ 
nal  articles.  One  journal  article  :I7J  was  an  invited  paper  (and  also  an  invited  conference 
talk),  and  one  paper  |6j  received  honorable  mention  in  a  conference. 
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B.  SUMMARY  OF  THE  MOST  IMPORTANT  RESULTS 

1.  Non-monotonic  reasoning  and  circumscription. 

McCarthy  [A]  has  developed  a  form  of  non-monotonic  reasoning  called  circumscription. 
Circumscribing  a  predicate  P  is  an  important  aspect  of  most  problems  in  artificial  intelligence 
in  which  the  user  generally  wants  to  consider  only  the  facts  at  hand  and  no  others.  Given  a 
sentence,  A(P),  of  the  first  order  predicate  calculus,  in  which  the  predicate  P  appears,  then 
McCarthy  ’s  original  schema  may  be  written  as, 

C(Z):  A(Z)<fc(x)(Z(x)  -  P(x))  -  (yXP(y)  -  Z(y)). 

That  is,  if  for  any  formula  Z(x),  it  can  be  shown  that  the  first  two  parts  of  the  schema  are 
true,  then  one  can  conclude  that  only  Z-things  may  be  P-things.  Thus  if  missiles  m7  and  m8 
are  known  to  be  functional,  m9  to  be  non-functional,  and  no  data  is  available  on  mIO  and 
mil,  then  ordinary  circumscription  of  the  predicate  Unfunctional(x)  would  lead  to  the  conclu¬ 
sion  that  mIO  and  mil  are  not  Unfunctional,  i.e.,  that  they  are  functional  Here  P(x)  would 
be  Unfunctional(x),  and  Z(x)  could  be  taken  to  be  x  =  m7  v  x=m8  v  x=m9 

We  generalized  McCarthy's  schema  to  allow  protecting  certain  atoms  P(a)  from  being 
decided  negatively.  Suppose  as  before  that  missiles  m7  and  m8  are  known  to  be  functional, 
m9  to  be  non-functional,  and  no  data  is  available  on  mIO  and  mil.  However,  suppose  also 
that  we  have  some  evidence  that  mIO  may  be  Unfunctional,  but  it  is  inconclusive  as  yet.  We 
may  wish  to  block  the  default  conclusion  that  mIO  is  functional,  and  await  further  evidence. 
In  this  case  McCarthy’s  schema,  as  it  has  been  written,  does  not  apply.  The  schema  was 
revised  by  us  as 

C(Z):  A(Z)<Mx)(Z(x)  S(x)  -  P(x))  -  (y)(P(y)  S(y)  -  Z(y)), 
where  by  Z(xpS(x)  we  mean  Z(x)&'->S(x). 

This  concept  of  “protected  circumscription”  is  described  in  our  paper  12;.  McCarthy  B 
has  also  extended  his  earlier  concept  of  circumscription,  and  his  extension  subsumes  the  con¬ 
cept  of  protected  circumscription,  although  as  noted  below  it  does  not  lend  itself  as  readily  to 
computation  in  certain  cases. 

In  our  paper  we  study  computational  issues  and  show  how  protected  circumscription  can 
be  incorporated  into  PROLOG  by  a  modification  to  the  negation  operator.  We  also  investi¬ 
gated  computing  circumscription  in  the  case  of  simple  forms  of  data  (called  Horn  data)  with 
additional  protection  (indefinite  data),  an  intermediate  investigation  between  Reiter’s  result 
C  on  predicate  completion  and  Lifschitz’s  efforts  D  to  make  general  (formula)  circumscrip¬ 
tion  more  efficient  as  a  computational  tool.  Reiter's  work  showed  a  close  tie  between 
McCarthy’s  circumscription  and  Clark's  predicate  completion  [Kj.  We  investigated  a  similar 
tie  between  an  extended  version  of  circumscription  involving  protected  data,  and  an  extended 
version  of  predicate  completion.  When  we  have  a  fully  ground  atomic  protected  theory,  we 
show  that  an  extension  to  the  relational  algebra  ran  be  used  to  obtain  all  (and  only)  correct 
answers.  When  general  Horn  axioms  are  added  to  the  protected  theory,  we  show  that  Horn 
axioms  also  can  be  used  to  compute  sound  answers;  however,  some  correct  answers  will  not  be 
found. 

In  another  study,  we  investigated  the  model  theory  of  the  notion  of  circumscription,  and 
found  completeness  theorems  that  provide  a  partial  converse  to  a  result  of  McCarthy.  We 
show  that  the  circumscriptive  theorems  are  precisely  the  truths  of  the  minimal  models  (i.e., 
models  in  which  the  R-things  form  subsets  of  the  domain  which  cannot  be  made  smaller  and 
remain  consistent  with  the  axioms)  in  the  case  of  various  classes  of  theories,  and  for  various 
versions  of  circumscription.  This  of  course  is  what  is  expected,  since  minimization  of  P-things 
is  the  purpose  of  circumscribing  the  predicate  P.  However,  Etherington  et  al.  [F|  and  Kueker 
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[Gj  have  noted  that  this  is  not  always  the  case,  so  that  it  is  reassuring  to  have  such  a  result 
providing  intuitive  correctness.  This  work  we  reported  in  (3j. 

Sets  can  play  an  important  role  in  circumscription’s  ability  to  deal  in  a  general  way 
with  certain  aspects  of  comtnonsense  reasoning.  Kueker’s  result  mentioned  above  indicates 
that  sentences  that  intuitively  one  would  want  circumscription  to  prove,  are  nonetheless  not 
so  provable  in  a  formal  setting  devoid  of  sets.  Furthermore,  when  sets  are  introduced,  first- 
order  circumscription  handles  these  cases  very  easily,  obviating  the  need  for  second-order  cir¬ 
cumscription  The  Aussonderungs  axiom  of  ZF  set  theory  plays  an  intuitive  role  in  this  shift 
back  to  a  first-order  language.  The  paper  [10j  presents  this  work.  Further  ramifications  of  set 
theory  in  commonsense  reasoning  are  presented  in  [9j,  where  it  is  argued  that  set  theory  pro¬ 
vides  a  powerful  addition  to  commonsense  reasoning,  facilitating  expression  of  meta¬ 
knowledge,  names,  and  self-reference.  Difficulties  in  establishing  a  suitable  language  to 
include  sets  for  such  purposes  are  discussed,  as  well  as  what  appear  to  be  promising  solutions. 
One  issue  highlighted  in  this  paper  is  that  it  is  important  to  be  able  to  regard  the  universe  of 
discourse  itself  as  being  an  object  of  discourse;  this  runs  into  problems  related  to  Russell's 
paradox.  Possible  solutions  are  suggested. 

S.  Belief  systems  and  deductive  databases 

Our  work  on  belief  systems  includes  much  that  also  deals  with  non-monotonic  reason¬ 
ing.  In  this  section  we  describe  that  portion  which  emphasizes  belief  systems  as  essential 
aspects  of  any  intelligent  attempt  to  answer  queries  in  deductive  databases  This  includes 
what  is  variously  described  as  “cooperative  query  answering’’  and  the  cooperation  princi¬ 
ple.”  The  idea  is  that  often  a  literal  answer  to  a  query  (or  question)  is  not  what  is  wanted,  or 
is  even  misleading  For  instance,  the  query  “Did  Smith  take  EFL  620’”  may  have  the  literal 
answer  “No.”  But  the  more  informative  answer  may  be  “There  is  no  EFL  620  ”  if  there  is  no 
such  course  as  EFL  620. 

Gal  and  Minker  have  in  their  papers  [1,13  pursued  natural  language  aspects  to  the 
query-answer  issue.  They  have  developed  a  general  theory  as  to  how  to  provide  natural 
language  intelligent  or  cooperative  (rather  than  simply  literal)  responses  to  queries.  Their 
approach  takes  advantage  of  integrity  constraints  that  exist  for  a  database.  Detailed  heuristics 
have  been  developed  for  this  purpose.  We  are  currently  considering  an  implementation  of  our 
general  method  in  PROLOG.  As  a  first  step  in  this  regard  we  have  developed  a  meta- 
interpreter  in  PROLOG  .18,  that  combines  integrity  constraints  with  axioms  in  logic  pro¬ 
grams.  The  meta-interpreter  is  currently  running  and  we  plan  to  extend  the  meta-interpreter 
to  permit  cooperative  answers  to  be  obtained. 

Miller  and  Perlis  [12.14  studied  interactions  between  theorem-proving  and  natural 
language  processing.  In  particular,  they  discuss  Ohlbach's  claim  that  first-order  logic  is  not 
well  suited  to  handling  certain  problems  involving  truth  of  utterances.  They  provide  another 
interpretation  of  the  problem  using  indexicals,  and  axiomatize  it  so  that  the  desired  results 
follow.  They  conclude  by  suggesting  a  broader  context  for  dealing  with  utterances  in 
automatic  theorem-proving. 

Another  issue  involving  language  is  that  of  meaning,  in  the  following  sense.  If  a  system 
employs  symbols,  in  what  sense  are  they  symbolic,  of  what  are  they  symbolic,  and  in  what 
sense  is  it  the  system  that  makes  them  symbolic?  In  other  words,  what  does  it  take  for  a  sys¬ 
tem  to  be  such  that  it  can  have  beliefs  that  are  about  something?  We  suggest  an  answer 
based  on  the  idea  of  quotation  or  reification,  namely  that  both  the  symbol  and  its  purported 
meaning  must  be  represented  within  the  reasoning  system,  for  instance  both  the  word  ‘dog’ 
and  some  (other)  representation  taken  for  a  dog  (such  as  a  picture).  Here  the  word  can  be 
regarded  as  a  linguistic  reification  of  the  picture.  Such  a  scenario  might  be  able  to  account  for 
the  drawing  of  conclusions  as  to  the  meaning  of  a  word.  This  is  reported  in  [111. 
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In  [17]  Minker  discusses  work  in  deductive  databases  that  has  taken  place  over  the  last 
30  years.  He  presented  an  invited  talk  at  the  Principles  of  Databases  Conference  and  submit¬ 
ted  an  invited  paper  on  the  subject  that  appeared  in  the  Journal  of  Logic  Programming  [17]. 
Deductive  databases  are  important  and  provide  the  basis  for  knowledge-based,  belief-based, 
and  expert  database  systems,  since  it  is  usually  the  inferences  or  deductions  that  may  be 
drawn  from  given  beliefs  that  is  of  interest  in  reasoning  about  intelligent  behavior. 

S.  Resource-limited  non-monotonic  belief  systems 

Non-monotonicity  is  pervasive  in  commonsense  reasoning,  and  therefore  comes  into 
most  of  our  work,  including  that  on  circumscription  and  deductive  databases  above  However, 
certain  of  our  efforts  have  focussed  bn  classical  problems  in  the  literature  of  non-monotonic 
belief  systems  such  as  “When  is  it  reasonable  for  an  intelligent  agent  to  believe  a  bird  can 
fly”  and  “When  does  lack  of  a  belief  that  P  is  true,  imply  the  falsity  of  P?”  We  have  studied 
a  real-time  mechanism,  which  we  call  step-logic,  to  address  these  problems. 

We  proposed  that  a  new  kind  of  logical  study  is  appropriate  to  agents  engaged  in  com¬ 
monsense  reasoning,  namely,  one  that  focuses  on  the  steps  of  reasoning  at  any  given  time 
rather  than  the  collection  of  all  conclusions  ever  reached.  This  was  reported  in  [4j  by  Drapkin 
and  Perlis.  We  then  carried  out  this  program  for  the  propositional  rase,  and  in  particular 
gave  a  result  on  completeness  for  reasoning  about  agents;  see  [7, 

The  kind  of  resource  limitation  that  is  most  evident  in  commonsense  reasoning  (i.e.,  in 
reasoning  about  and  within  a  real  environment)  is  simply  the  passage  of  time  while  the  rea- 
soner  reasons.  There  is  not  necessarily  (or  even  likely)  any  fixed  and  final  set  of  consequences 
with  which  such  a  reasoning  agent  ends  up.  What  is  of  interest  for  such  an  agent  is  not  its 
“ultimate’'  set  of  conclusions,  but  rather  its  changing  set  of  conclusions  over  time.  Indeed, 
there  will  be,  in  general,  no  ultimate  or  limiting  set  of  conclusions. 

In  contrast  to  already  existent  approaches,  we  have  proposed  step-logic  to  model  reason¬ 
ing  that  focuses  on  the  on-going  process  of  deduction.  The  reasoner  starts  out  with  an  initial 
set  of  axioms  at  time  0  At  some  time,  i,  it  concludes  theorem  a,  at  some  later  time,  j,  it 
comes  up  with  S.  Of  course,  this  much  might  be  said  of  any  deductive  logic.  However  in 
step-logic  these  time  parameters  can  figure  in  the  on-going  reasoning  itself 

An  interesting  problem,  related  by  Moore,  is  the  following.  One  is  able  to  reason. 
“Since  I  don’t  know  I  have  a  brother,  I  must  not.”  This  problem  can  be  broken  down  into 
two:  the  first  requires  that  the  reasoner  be  able  to  deride  he  doesn’t  know  he  has  a  brother; 
the  second  that,  on  that  basis,  he,  in  fact,  does  not  have  a  brother  (from  modus  ponens  and 
the  assumption  that  “If  I  had  a  brother.  I’d  know  it.-')  The  first  of  these  seems  to  lend  itself 
readily  to  step-logic,  in  that  the  negative  reflection  problem  (determining  when  something  is 
not  known)  should  reduce  to  a  simple  look-up.  In  our  paper  we  presented  a  real-time  solution 
to  Moore’s  Brother  Problem,  with  computer-generated  results  for  three  different  scenarios 
involving  determining  whether  or  not  the  proposition  that  a  brother  exists,  holds. 

Specifically,  we  have  implemented  a  real-time  inference  mechanism  that  correctly  infers 
a  lack  of  knowledge  of  certain  wffs;  that  correctly  will  not  infer  a  lack  when  the  knowledge  is 
in  fact  present;  and  that  correctly  resolves  a  contradiction  when  timing  is  such  that  new 
knowledge  arises  conflicting  with  a  prior  (or  simultaneous)  conclusion  of  its  lack.  Of  course, 
we  have  shown  this  only  in  a  very  limited  context  so  far.  One  interesting  feature  is  that  it  is 
not  at  all  critical  whether  a  contradiction  is  instantly  resolved.  In  step-logic,  the  agent  can 
continue  reasoning  step-by-step  in  the  presence  of  a  contradiction.  The  possible  “spread"  of 
invalid  conclusions  from  a  contradiction  itself  goes  only  step-by-step,  thus  presenting  the  pos¬ 
sibility  of  controlling  it  by  effective  means. 

Further  work  in  non-monotonic  belief  systems  includes  a  philosophical  treatment  in 
which  non-monotonic  (or  “default")  reasoning  is  analyzed  as  consisting  (implicitly)  of  at  least 
three  further  aspects,  that  we  call  oracles,  jumps,  and  fixes,  which  in  turn  are  related  to  the 
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notion  of  a  belief.  Beliefs  are  analyzed  in  terms  of  their  use  in  a  reasoning  agent,  and  an 
idea  of  David  Israel  is  embellished  to  show  that  certain  desiderata  regarding  these  aspects 
of  default  reasoning  lead  to  inconsistent  belief  sets.  As  a  consequence  the  handling  of  incon¬ 
sistencies  must  be  taken  as  central  to  commonsense  reasoning,  lending  support  for  our  above 
work  in  step  logic.  Finally,  these  results  are  applied  to  standard  cases  of  default  reasoning  for¬ 
malisms  in  the  literature  (circumscription,  default  logic,  and  non-monotonic  logic),  where  it 
turns  out  that  even  weaker  hypotheses  lead  to  failure  to  achieve  commonsense  default  conclu¬ 
sions.  This  was  reported  in  [8]. 

One  surprising  result  was  that  a  “counter-example"  axiom,  to  the  effect  that  defaults 
(typicality  rules)  have  exceptions,  undoes  the  effectiveness  of  certain  formal  approaches  to 
NMR.  For  instance,  the  axiom  (x)(BIRD  x  Ar-ELIES  x)  prevents  circumscription  (at  least  in 
the  usual  straightforward  uses)  from  concluding  FLIES  tweety  given  the  information  BIRD 
tweety.  Thus  when  formal  reasoners  are  made  to  know  certain  aspects  of  their  own  forms  of 
reasoning  (e  g.,  that  certain  information  is  tentative  and  error-prone)  unexpected  behaviors 
can  result.  Further  results  on  inherent  difficulties  in  formal  approaches  that  do  not  incor¬ 
porate  appropriate  distinctions  of  temporal  aspects  of  reasoning  are  given  in  ■  1 6 j . 

4-  Parallelism  in  non-monotonie  belief  systems 

Parallelism  has  recently  gained  widespread  attention  within  AI,  and  more  generally 
within  Computer  Science.  The  principal  motivation  is  the  expected  speed-up  when  many  pro¬ 
cessors  execute  simultaneously,  as  opposed  to  one  processor  executing  activities  in  sequence. 
.Another  motivation  stems  from  the  inherently  parallel  features  of  computer  networks,  and  a 
third  is  the  highly  parallel  processing  in  the  human  brain  which  is  a  major  source  of  insight  in 
cognitively-oriented  studies  within  AI. 

As  another  step  in  our  efforts  toward  the  study  of  real-time  monitoring  of  the  inferential 
process  in  reasoning  systems,  we  have  studied  a  meta-level  method  of  representing  knowledge 
for  parallel  default  reasoning.  A  meta-level  implementation  that  permits  effective  monitoring 
of  the  deductive  process  as  it  proceeds,  providing  information  on  the  state  of  the  answer  pro¬ 
curement  process,  has  been  designed  for  the  Parallel  Inference  System  (PRISM)  at  the  Univer¬ 
sity  of  Maryland. 

PRISM  is  a  parallel  logic  programming  system  developed  to  execute  logic  programs  by 
solving  the  implicit  AND  OR  tree  that  is  defined  by  a  query  and  a  program.  Parallelism  is 
achieved  by  distributing  portions  of  the  tree  to  different  processors.  Although  PRISM  can 
exploit  parallelism  transparently  the  user  may  annotate  his  program  and  explicitly  control  the 
parallel  execution.  A  PRISM  program  consists  of  a  finite  set  of  annotated  Horn  clau--es 
defining  predicates.  A  predicate  could  be  defined  in  terms  of  other  predicates  or  facts  (unit 
clauses).  Also,  there  is  a  set  of  built-in  (predefined)  predicates  in  the  system  such  as 
SUM(X.Y.Z).  MUL(X,Y,Z),  X-  Y.  etc.,  that  can  be  used  in  these  definitions.  There  are  two 
implementations  of  the  system.  One  is  running  on  McMob  (a  parallel  computer  designed  and 
built  at  the  University  of  maryland),  the  second  is  running  on  a  Butterfly  but  this  is  a  primi¬ 
tive  version.  These  two  implementations  use  message  passing  techniques  for  communication 
between  processors. 

As  part  of  the  previous  ARO  grant  research,  we  devised  an  implementation  in  PRO¬ 
LOG,  to  be  incorporated  into  PRISM,  of  a  learning  feature  used  to  calculate,  for  purposes  of 
issuing  default  answers,  the  current  depth  of  inference  for  a  query  from  that  obtained  from 
similar  queries  posed  earlier.  See  our  paper  [5j.  This  work  was  our  initial  step  toward  using 
PRISM  for  our  work  on  belief  systems.  Additional  capabilities  are  required  in  PRISM  to 
implement  the  work  in  [5i. 
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